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ABSTRACT 

Evaluating the Writing To Read program (a 
computer-based reading/writing program developed by IBM for 
kindergarten children), a study examined the impact of the program on 
student achievement in the District of Columbia Public Schools. 
Writing To Read teaches students 42 phonetic sounds in the context of 
words that allow students to begin writing and illustrating their 
writings immediately. Phonetic spelling is used in writing to 
encourage students to use the range of words available in their 
vocabularies, and daily writing occurs without negative feedback. 
Metropolitan Achievement Test (MAT) scores were used from the 1986-87 
school year for 86 kindergarten and 130 first grade students in the 
program, and 155 kindergarten and 152 first grade students in control 
groups. Writing samples were coir.ected from the treatment and control 
groups as indicators of student writing ability during the fall and 
spring. Teacher attitudes and experiences relative to the program 
were also collected and evaluated using a teacher-survey instrument. 
Findings indicated that kindergarten students who participated in the 
Writing To Read program made significant gains in reading and 
language achievemf^nt , and students in the program scored 
significantly higher on reading achievement than did the comparison 
group. First grade students in the program did not differ 
significantly from comparison group reading achievement scores. 
(Twenty-two tables are included, and 13 references are appended.) 
(MM) 
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EXECUTIVE SUMMARy 



Ihe Writing to Read program (W2R) is a oonputer-based readim/writing 
program developed ty lEM for kindergarten children. Kindergarten students 
are tau^t forty-two (42) phonetic sounds (phonemes) in the context of 
words that let them begin writing and illustrating their writings 
unraediately. Rionetic spelling is used in writing to encourage students 
to use the range of words available in their vocabularies. First grade 
students in the W2R schools are ejqposed to a DCPS based extension of the 
kindergarten W2R program but have either limited or no access to 
coitpiters, typewriters or other technology. 

Ihis evaluation study endeavored to answer the question: 

What is the lirpact of the Writii^ to Read 
program on student achievement in DCPS ? 

Specific questions asked to help us understand the iitpact of WR on 
student achievement were: 

I. How do selected- 1986-87 W2R students perform on measures 
of reading and language achievement in corrparison with a no 
treatment graap by the end of the school year ? 

II. How do selected 1986-87 W2R students perform on measures 
of writing ability in ccanparison with a no treatment group 
by the end of the school year ? ^ 

III. What are Teacher assessments of sturlent progress relative to the 
W2R program? 

IV. How do the objectives and performance indicators related to the 
W2R program relate to the objectives and indicators of the DCPS 
Conpetency Based Curriculum in the area of writing? 

Ihfcj findings indicate that: . 

1. Kindergarten Writing to Read students scored significantly 
hitler on reading achievement than did the comparison groip. 

2. First g]r.ade Writii^ to Read students did not differ from 
ccarparison grot?) students in lai^uage and reading 
achievement. 



3. 



Kindergarten and first grade Writing to Read students made 
greater gains in writing ability and stage of writing 
developnent than did ccarparison graap students. 
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4. Independent raters demonstrated a hi^ level of (consistency 
in evaluating the stage of development of writiiyg sairples. 

5. Kindergarten and first grade Writing to Read Teachers 
documented the skills mastered and the degree of growth 
for W2R program students. 

6. Ihe ind^jendent consultant indicated the need to correlate 
W2R instructional activities with skills in the Cotnpetency 
Based Curriculum. 

7. The independent consultant dooimented the need for 
articulation and planning between the curriculm directors 
for reading and English and the W2R coordinator. 

Ihe findings indicate kindergarten" students participatii^ in the 
Writing to Eead program made significant gains in reading and language 
achievement as measured by the Metropolitan Achievement Tfest. First grade 
differences in achievement were not-significant. iSie lack of significance 
may be_ due in part to the eirphasis at first grade on stuJent mastery of 
the skills outlined in the Ccra^jetency Based Curriculian (CBC) and variance 
in the reinforcement of the skills acquired in the Writing to Eead program 
at the first grade level. Ihis conclusion is si^jported by the findings of 
Dr. Mattie C. Williams vdio served as a curriculum consultant for this 
study and the DOS writir^ evaluation study. Participating iteacOiers 
documented the progress made by most Writii^ to Read program students. 
Both the outside consultant and the ©valuator agree that a need exists for 
articulation and oorrelition between the Writing to Read program and the 
CBC in reading and writing. 



Recommendations 



Dr^ft copies of the evaluation report were delivered to Si^jervisors/ 
Principals and Teachers, selected by the evaluator, for persual. 
Representatives of the grax? that reviewed the report were invited to 
attend a meeting held at Young Elementary School to generate 
reooramendations based on the findii^ of the evaluation report. Aikw the 
ei^teen persons attending the meeting were the Si^jervisii^ Directors of 
English and Reading; the Assistant Director of Reading; two Regional 
Si5>ervisors; two Principals from schools involved in the stuc^ (one with 
Writing to Read and one without) ; one Early Childhood Peer Assistant 
Teacher; and five Teachers (three Teachers frcm schools with Writing to 
Read and_ two without) . Attending frcm the Writing to Read program were 
the Coordinator, the Consu].tant and the two Resource Teachers. 
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The following Recoranendations were generated based on the f djdings of the 
evaluation r^rfc. 



1. The relationship between the instrtic±ional skills ax^ activities 
provided through the Writing to Read program and the skills 
outlined in the Ocaipetency Based CXirriculum needs to be 
articulated to instructional personnel using the Writii^ to 
Read program. 

Presently, achievement in the Writing to Read program as it 
is measured by standardized achievement instnments indicates 
no difference exists between the performance of Writir^ to 
Read and ocsnparison graop first grade students. Persons 
generating this recoranandation at the Young School Meeting 
indicated one of the reasons for the lack of difference 
is that scane Principals and Teachers involved with Writing to 
Read esqperience difficulty understaniLng the relationship 
between the CBC skills and objectives and the objectives of the 
Writing to Read program. Tliey see the two as unrelated rather 
than as ocnplementary programs, since ^teachers are evaluated 
in part based on their ability to progress throu^ the CBC, they 
tend to eniphasize skills on the CBC checklist (especially since 
prcanotion is based cm student progress on CBC matheic-*-ics and 
reading cbjectives. Seme felt that the promotion stancJard 
v^ould be based on performance in mathematics, reading and 
writing) . It would follow that Writing to Read first grade 
student performance on achievement measures would not be 
different from conparison students if the materials and 
training provided to participating first grade Teachers is not 
being fully iaplemented. The participants attending the 
Young School Meeting recommended that staff developinent bo 
provided for Principals and Teachers which demonstratet. how 
the Writing to Read program reinforces CBC skills and \Adch. 
providas strategies for incorporatii^ Writing to' Read 
activities into the skills and objectives provided ty the CBC 
without limiting instructional opportunity in other subject 
areas. 
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2. Articulation and collaboration needs to be structured and reinforced 
between the Writing to Read program and the English and Readir^ 
Departments to foster cchesiveness am^ the three programs. 

More articulation needs to take place between the Writing to Read 
program and the English Department. The Writing to Read program 
staff has done an outstanding jcb of enhancing the writing 
develqpsnent of kindergarten and first grade students that is 
being recognized by educators acaxss the country. With the 
onset of the Writing Initiative, every elementary school Teacher 
could benefit- from learning how to apply the Writir^ Scale 
developed ty the Writir^ to Read program in DCPS to guage the 
ability and level of writing dsvelopment of ycjng children. 
Collaboration and articulation would also aid both grt)i?)s in 
spreading the word to elementary sdiools throu^ pr^entations 
and workshops with system Writing Coordinators, Principals and 
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Teachers. Ihe English Department has a network already in place 
that vcfuld facilitate this (eg. , Writing Coordinators, Language 
Arts Resource Teachers, the Writirg Initiative Newsletter, etc.) . 
In order to prcsnote cchesiveness between activities related to 
the ^Triting to Read program and the writir^ caarriculum, teachers 
presently iirplementing the Writing to Read program should be 
considered vdien fondng curriculum development teams. 

The Writing to Read program and the Readily Department have 
worked together previously to comilate the activities contained 
in tha Writing to Read program with the CBC reading cbjectives. 
Bie two should v?oric together to share the ccaiponents of the 
Writing to Read program with Reading Resource Oteachers and 
other appropriate personnel in various forums provided by the 
Writing to Read program and the Reading Department. In addition, 
Writing to Read program activities and cbjectives should be 
reviewed in li^t of recent modifications in the readiix? 
currioiLum. 



An avrareness strategy needs to be established to share information 
on the skills developed by the Writii^ to Read program across schools 
aisd primary grade levels. 

Ihis reccranendation encourages more frequent articulation and 
collaboration between kindergarten and first grade Writii^ to 
Read Teachers in each school as well as plannii^ ani sharing 
with Teachers in grades two throu^ sii: (with strategies provided 
for ::einforcing learned writing skills) . A concerted effort 
should also be provided for Teachers ej^jerienced with the Writing 
to Read program to share with new program participants in formal 
and informal settings so participants approach the program 
with realistic expectations. !lhis infomation should also be 
shared in fonms involving non-participating schools, 
Principals and Si^jervisors so knowledge of the Writing to Read 
program can be expanded. Ihe ultimate goal of this 
reccraraendation is to develop a mechanism to share ard build vpon 
the skills developed by the Writing to Read program with others. 
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AaiLEVEllENr IN IHE: VJRniNG TO READ ERDGRAM: 
A CXMPARAITVE EVAIUMTCN STUDY 



Bducaticsnal technology in the classrocm has developed beyond the vse 
of audio-visual equipnent and television. Millions of dollars are spent 
annually developing and marketing educational programs for use with the 
new educational medium: microcaiputers. Eie Writir^ to Read program 
(W2R) is one of the educational programs that has been develqped vMch 
uses microcoifxiters as an educational medium. 

Jdin H. Martin (1982) developed W2R as a writir^ program because he 
believed teadiing kindergarten children to write was a better introductory 
process to reading than was the traditional strategy whidi etrphasi^ed 
reading before writing. International Business Machines (lEM) adapted 
Martin's program and field tested the W2R program as a writir^ program 
that would inprove reading during 1982-83 using 10,000 kirdergarten and 
first grade students. 

Die District of Ooltmibia Public Schools (DCES) had fifteen schools 
involved in the original pilot program (1982-83) sponsored by lEM for 
Writing to Read. The fifteen pilot sdiools were eval^jated by Research and 
Evaluation in 1985. Kindergartners and first grade students in 
twenty-seven (27) schools participated in W2R during 1985-86 (2,812 
students from 113 classrocms) . Each year, the W2R program has expanded to 
additj.onal schools. Durijng 1987, students from 43 schools in DCFS were 
involved in the W2R program. 



Description of the Writing to Read Program 
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Tlie W2R program consists of a coipiter-based writirg program, 
correlated work journals, typewriters, tape recorders, games, st?piemental 
language develcpnent activities and free writing. Kindergarten students 
are tau^t forty-two (42) plionetic sounds (phonemes) in the context of 
words _ that let them begin writing and illustratirg their writings 
iranediately. Kionetic spellirg is used in writii^ to encourage students 
to use the range of words available in their vocabularias. Dailv writing 
occurs without negative feedback. 

Ihe first six to ei^t weeks of the W2R program involves the 
develcpnent of kindergarten readiness skills such as awareness of letter 
sounds, blending, letter recognition, ke^x>ard faioiliarity ard letter 
formation. Following language readiness, kindergarten students ar^ 
schfeOuled into a language develcpnent center (the Writii^ to Read Center) . 
A ccaiputer tutorial introduces the students to two or three words for each 
of the 42 phcanetic sounds. At the same time, kindergarten students are 
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provided vdth classrooo writiig instrvicfcion thai-, focuses on blending, v?ord 
stcdy and free e:<pression of ideas. Factors usually e^^iiasized at thLs 
level, such as penmanship ard correct spelling, are given little 
attention. Students phonetically spell the words tt^ey speak and hear. 
First grade students in the W?.R schools are ej^osed to DCPS based 
extension of the 3dndergarten p\*ograra but have "lad either limited or 
no access to ccnpiters, typewriters or other tecijnology. 

Writitig is the focus of the language arts program. Wherever rossible 
the sJdIls and processes the children are 'tau^t result in" written 
producta. Initially they writa for free ej^sression. bat as they advance 
in writing they demonstrate sJdll dsvelc^avsnt throu^ written products 
which take on a variety of fomats (s.g. , stories, poetry and r^rts) . 
In addition to their regular writirg assignrosnts, the cSiildren are asked 
to write on a design:_>od thesne or tqjic three tiroes a year. TSie products 
are sutaaitted to the W2R staff for analysis of writing dsvelcjxnent. 

Teachers at participating schools attend staff develcpnent sessions to 
learn a phonetic approach to teaching writir^ sr^ a host o.f writii^ 
strategies. Oliey are also trained relative to the stages tlirough \Mch 
ch.'J.dren progress as they develop writir^ skills. Generally, two to five 
days per year have been scheduled for !Iteacber staff develcpnent. 



Statement of the Pccblem 



Data fmn the 1985 arsi 1986 evaluation studies conducted by Research 
and Evaluation provide evidence that H2R prc^rain students produce better 
i-nriting sanples at a more ad-zanced level of skill and hi^ier achievsnent 
in readiDg and language tiian does a canparison gxxup at the kindergarten 
(McBeath & Arenas, 1985? MoBeath, 1986) and first grade lfive3.s (McBeath, 
1986) lsvaa.uation of W2R during 1987 will assist in vseidrg dscisions 
relative to program inplementation in all schoo]^ that have kindergarten 
classes. Such data may iapact on, vfliethar a DCPS develc^ W2P. nodel 
should _ be inplemsnted at the first grade level. G5ierefore, this 
evaluation study will endeavor to ask the general question: 

Wiiat is the inpact of" the Writijig to Read 
program on student achieve!ivent in DCES ? 

Specific questions asked to help us understand the inpact of W2R on 
student adiievemsnt were: 



Eva3.uation Questions 



I. Hw; do selected 1986-87 W2R students perform on iteasures 
of reading and leinguaga achievement in ccaiparison with a no 
treatment grcxp by the ex^ of the tr-diool year ? 

II. Hew do selected 1986-87 W2R students perform on msasures 
of writing ability in ccaiparison with a no treatiasnt groim 
by the end of the school year ? 
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m. What are Teacher assessments of student progress relative to the 
W2R program? 



IV. How do the objectives and perfontance indicators related to the 
W2R program relate to the objectives and iMicators of the DCPS 
Ccerpetency Based Qjrriculm in the area of writing? 



A focus on the fcwr evalxiation questions should give us a vision of the 
inapact of the Writing to Eead program on the achievenent of students \}ho 
have e:5)erienced the program and the relationship of the W2R program to 
the DCPS writing curriculum strand. Biis information will assist 
stakeholders in making _ reocraraendations and decisions relative to the W2R 
program and in formulating a systemwide strategy for directing W2R progi^m 
ejqansion and services. 



Methodology 



The principal student data source for this study were scores on the 
Metropolitan Achievement Test (MAT) , Form L for total reading and total 
language and stages of writing ability data collected durii^ the 1986-87 
school year for selected kindergarten and first grade students in the W2R 
and oorrparison groi:?>s. The MM? pre-test measures were the pre-primer 
level for kindergarten and the primer level for first grade. The MM* 
post-test measures were the primer for kindergarten and the primary 1 for 
first grade. Data for this sairple enrolled in the DCPS during 1986-87 
were collected during the Spring of 1987 and were analyzed using 
inferential statistical procedures that detect differences between 
tcmtment and control groins. 

Writing saitples ware collected from treatment and comparison group 
students at the kindergarten and first grade levels as indicators of 
student writing ability durii^ the fall and spring. The writii^ saitples 
were rated by a cadre of trained educators in terms of stage of writing 
development using a writing scale developed by Dr. Deloris Saunders, 
consultant for Writing to Read. 

An independent curriculimi consultant in the area of language arts was 
hired to correlate and evaluate the ma.tch between the objectives and 
indicators of tlie W2R program and the DCPS writing curriculm strand as 
defined in the Canopetency Based Curriculimi. 

Teacher attitudes and e^^jeriences relative to the W2R program were 
collected and evalioated throu^ the administration of an end of year 
Teacher survey instrument. 



Data Analysis 

Statistical analysis procedures appropriate to the data collected (as 
noted under methodology) were used to analyze the data. An alpha level of 
.05 was set as the level of significance for this study. Analysis of 
Oovariance and T-tssts were used to evaluate graxp differences in student 
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performance csn reading and language developent Indicators and writing 
ability, respectively. Frequencies were generated for the Iteacher survey. 



FINDINGS 



Data frcm the mr pre and post achievement measures, the pre and post 
writJi^g samples, the kindergarten and first grade Tteacher surveys aM the 
curriculiM correlation are presented in this section xasing the evaluation 
questions as headings for each set of findings. 



Reading And Lanouacre Achievement 



I. 



Ifow do selected 1986-87 W2R students perform on measures 
of reading and language achievement in carpariscn with a no 
treatment groip by the end of the school year ? 



Frcm pre- to post-test there was an increase in the average score for 
each treatment grot?) (Tables 1 and 2) . The greatest difference occured in 
the kindergarten es^imental graap on the reading test. For this graap 
there was an average increase of alirost 70 points. The smallest increase 
occured in the First grade ejqperimental group on the language test with an 
average increase of about 12.5 points. Correlated T-tests were done to 
determine the statistical relationship between the pre- and post-test 
assessments among the different graxps (TSables l and 2) . 
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Table 1 



Descriptive Statistics and Oorrelatea T-Ttest Data 
from Pre- to Post-Test in Readim and lamuaae 
Achlevemant By Treatment Group 



Kindercfa2±en 



CJontrol Group (lf=155) 



1 Tfest 


1 Ere-Test | Post-Test 
1 Mean | Mean 


1 Difference 


|T-Value 


1 2 Tail 1 
Prdbabilityj 


Corr. 1 


1 Reading 


1 415.85 1 468.70 
1 75%ile 1 82%ile 

1 1 

1 (S.D.=51.13) 1 (S.D.=44.62) 

1 1 


1 52.85 


1 15.11 


1 <.001 1 


.59 1 


1 language 


1 480.91 1 513.64 
1 66%ile 1 83%ile 

1 1 

1 (S.D.=39.45) 1 (S.D.=47.80) 

1 1 


1 32.73 


1 10.12 


<.001 1 


.59 1 


Writing to Read Grcujop (N=86) 


1 Test 


1 Ere-Test | Post-Test 
1 Mean 1 Mean 


Difference 


|T-Value 


2 Tail 1 
Prdbabilityj 


Corr. 1 


1 Reading 


1 399.70 1 470.41 
1 64%ile 1 84%ile 

1 1 

1 (S.D.=38.21) 1 (S.D.=54.20) 

1 1 


70.71 


1 16.82 1 


<.001 1 


.70 1 


1 language 


1 473.73 1 494.51 
1 66%ile i 76%ile 

1 1 

1 (S.D.=46.27) 1 (S.D.=37.02) 

1 1 1 


20.78 


1 4.12 1 


<.001 1 


.39 1 
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Table 2 



Descriiative Statistics and Correlated T-Test Data 
from Pre- to Post-^rest in Reading artd Language 
Achievement By Treatment Group 



First Grade 



1 1 Control Groi?) (1^152) i 


1 Test 


1 Pre-Test | Post-Test 
1 Mean | Mean 


1 Difference |T-Value 
1 1 


1 2 Tail 1 
IPrcibabilitYl 


COrr. 1 


1 Reading 


1 476.41 1 527.30 
1 72%ile 1 66%ile 

1 1 

1 (S.D.=54.59) 1 (S.D.=51.23) 

1 1 


1 50.89 


1 17.31 


<.001 1 


.77 1 


1 language 


1 523.69 1 544.09 
1 75%ile 1 82%ile 

1 1 

1 (S.D.=45.85) j (S.D.=43.13) 

1 1 


1 20.40 


1 6.83 


<.001 1 


.66 i 


Wtitii^ to Read Group (N=130) 


1 Test 


1 Pre-Test | Post-Otest 
1 Mean I Miean 


Difference 


|T-Valvie| 


2 Tail 1 
Prdbabilityl 


Corr. 1 


1 Reading 


1 511.86 1 542.28 
1 92%ile 1 

! 1 

1 (S.D.=60.40)1 (S.D.=39.63) 

1 1 


30.42 


8.17 1 


<.001 1 


.71 1 


1 Language 


1 544.44 1 556.95 | 
1 84%ile 1 88%ile | 

1 1 1 
1 (S.D.=^39.99) 1 (S.D.=48.67) | 
1 1 1 


12.51 


3.82 1 


<.001 1 


.66 1 
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Die analyses indicated that for each grade level and for both control 
and e:>5)eri2nental groups, the differences between pre- and post-test scores 
were hi^y significant. In each analysis the 2-tail probability was. less 
than .001. The correlation coefficients between the pre- and pcet-test 
scores were relatively hi^. The hi^est correlation coefficient was .77 
for the pre-reading first grade control and the lowest was .39 for the 
pre-language kindergarten ej^jerimental grcxsp (Tables 1 and 2) . 

Ihe Analysis of Covariance (ANOOVA) statistical procedure was used to 
detect differences between e^^isental (W2R) and control graops on each 
of the post-tests for each grade level (Tables 3 and 4) . ANOJVA was xased 
to control for pre-test differences between the e3q)eriraental and control 
grcH?)s so that post test gains could be analyzed more accurately. For 
kindergarten students, there was a significant difference favoring the 
experimental graap on post-reading scores. A significant difference 
favoring control grotp kindergarten students was found on post-language 
scores. For the first grade students, differences between the control and 
ejqjerimental groi;?>s on post-reading and post-language scores were 
not-significant. 



Table 3 



Analysis of Covariance Tables For Kindercfarten; 
Post-Test Analy ses 



Reading Achievement 



Source 


SS 


df 


m 


F 


Treatment 
Ebqjlained 


7552.88 
207851.66 


1 
2 


7552.88 
103925.83 


5.15* 
70.95* 


Total 


556475.66 


240 








lanouacre Achievement 






Source 


SS 


df 


MS 


F 


Treatment 
Ej^lciined 


12802.41 
142310.74 


1 
2 


12802.41 
71155.37 


8.80* 
48.90* 


Itotal 


488626.60 


240 







*p < .05 
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Table 4 



Analysis of Oovariance Tables For First Grade: 
Post-Test Analyses 



Reading Achievement 



Source 


SS 


df 


H5 


F 


Treatnent 
Ej^lained 


2295.83 
337684.25 


1 
2 


2295.83 
168842.12 


2.31 
170.11* 


Itotal 


614606.07 


281 








lanouaae Adiievement 






Source 


SS 


df 


MS 


F 


Treatment 
E}5)lained 


150.70 
262807.94 


1 
2 


150.70 
131403.97 


0.13 
109.37* 


Ototal 


598023.87 


281 







*p < .05 
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Grcwth In Stage Of Wrltiner 



H. Hew do selected 1986-87 W2R students perform on measures 
of writing ability in ccnparison with a no treatment groqp 
by the end of the school year ? 



Table 5 summarizes the growth of student writii^ ability by grade 
level and treatment qrtxps across 1986-87. In all instances, student 
growth in terms of the stage of writing ability was significant at the 
.0001 level of oonfidenoe. Students advanced in terms of the level of 
skill in writing frm the collection of the pre-writing sample to the 
post-writing sample. 

Table 6 oottpares the level of writing ability of students at the end 
of the school year by grade level. Writii^ to Read program students made 
significant advances in terms of stage of writing ability at kirdergarten 
and first grade (p <.0001) in corrparison with the control grcxjp. 

Table 7 summarizes the reliabilty of the ratings of student placement 
in one of the ten stages of writing development usii^ the Spring writing 
sanples; ihe ratings by trained educators iaiLcate a hirfi level of scorer 
reliability (agreement) overall (88%). 
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Table 5 



Pre-Post Wcitim Ability Data By Grade Level 
and Treatment; 1986-87 

Klndetxaarten 



j Grcxip j 


Mean 


j # of Cases 


T-Value 


2-Tail Prob 


IWriting toj | '| . | . i 
jPeacV K 1 1 1 - 1 


1 1 


2.58 












1 224 


28.70 


.0001 1 


1 Post 1 


5.96 




1 Control 1 










\Graa£)/ K | 










1 £^ 1 


2.11 












1 156 


17.76 1 


.0001 1 


1 Post 1 


3.19 





First Grade 



i Gxxiap j 


liean 


j # of Cases 


T-Valvie 


2-Tail PkA) 


[Writing to| | | 

iReacV 1 1 1 II 


1 1 


4.43 


1 231 


23.94 1 


.0001 1 


1 Post ! 


6.99 


1 Control II II 

iGroiK)/ 1 1 1 II 1 


1 ^ 1 


3.18 


1 211 1 


14.78 1 


.0001 1 


1 Post 1 


3.96 
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Table 6 



Comparison of Growth in the Stages of Writincr 
By Grade Igvel ar)d Treatment Group 



Treatment j 




j # of Cases j 


T-Value 


i 2-^rail Prdb. | 


Ctontrol 1 


3.19 


1 156 1 






K 1 






15.40 


1 <.0001 1 


Exp. 1 


5.96 


1 224 ' 1 



Control 1 


3.96 1 


211 






1st. 1 






1 21.03 


<.0001 


Exp. 1 


6.99 1 


231 



Table 7 

Reliability of Ratings of Writing Ability /Stages 



I Number of Identical | No. Ratings Differing | No. Ratir^ Differing 
1 Ratings 1 Bv One Pcaint I By More Than One Ftoint 

K I 81% I 9% I 10% 

j ( N = 71) j ( N = 8 ) I ( N = 9 ) 



! ^ '\ 

1 i 95% I 3% I 2% 

I ( N = 95) j ( N = 3 ) j ( N = 2 ) 

Total 88% 6% 6% 

( N = 166 ) ( N = 11 ) ( N = 11 ) 
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Teacher Assessments of Student Progress 



HI. What are 'leacher assessm^ts of student progress 
relative to the W2R program? 



RuTler t rarfcen Surrey 



Hiis section summarizes the results from the kindergarten and first 
grade Teacher surveys relative to student progress in the Writing to Read 
program. Surveys were mailed to each Writing to Read Teachers at schools 
included in the evalviation study during May 3987 (thirty-one kindergarten 
and twenty-nine first grade Teachers) . All of the Teachers returned 
ooirpleted surveys after a follow-i?> letter was mailed. For kindergarten 
classes that participated in the Writing-To-Read Program there was a mean 
of 24 students per class. Scmetimes students corrected their work without 
erasing and edited their own writ-ii^. As indicated by the table, students 
frequently practiced wrLtirg and vised their own thoui^its and ideas but 
only corrected and often edited their own writing (Table 8) . 

Table 8 

Students' Current Performance 



Question 



a) Students practice writing daily 

b) Students write using cwn thou^ts 
and ideas 

c) Students correct written work 
without erasing 

d) Students edit their writir^ 



Avg. Response 
on a scale from 
1-5* 

47? 
4.6 

3.9 

3.8 



^ ^ Ihirty-two percent of the kindergarten students wrote sentences 
consisting of between ei^t and eleven words (Table 9) . As many as 36% of 
the students used three syllables in the words they used (Table 10) . The 
hi^iest percentage of students (24%) was in the 8th stage of writing 
(Table 11) . ^ 'a 



* 5=always, 4==often, 3=sametlmes, 2=^carely, l=never 
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Table 9 

TbB Number of Sentences Used for Stories 



j Nuinber of Sentences 
1 Used for Stories 


i % of Students Using | 
1 Nuinber of Sentences ( 


1 1-3 


1 16% 1 


1 4-7 


1. 21% 1 


1 8-11 


1 32% 1 


1 12 or more 


1 31% 1 



Table 10 

The Nuitiber of Syllables Used in Worfs 





Nuitiber of Syllables 
in Words 


1 Percentage of Students | 




one 


1 22% 1 




two 


1 35% j 




three 


1 36% 1 




four 


1 7% 1 




five 


i 0% 1 
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Table 11 

Ihe Percentage of students in Each of the IQ Stages 
of Writing 



10 stages of Wtritim 1 


% of Students at Each Staoo 


1 1 1 




1 2 1 


±0*0 


1 3 1 




1 4 1 


6% 


1 5 1 


8% 


1 6 1 


12% 


7 1 


13% 1 


8 1 


24% { 


9 1 


3% 1 


10 1 


3% 1 



All of the Teachers agreed that students learned well from the 
program, and that they themselves enjoyed the program. Also, the Tteachers 
agreed that they were ccEraraitted to the program and were coofortable with 
its phonetic spelling eirjchasis (Table 12) . 
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Table 12 



ResTxaises to V?f itlm Questions 



j Questicais 


j Avg. Response to Questions j 




1 on a Scale frcan 1-5* | 


1 a) Students learn well fran the 




1 VJiritira to Read Proqram 


1 4.4 1 


1 b) I enjoy usirg the Wiriting to 




1 Read Prtxnram 


1 4.3 1 


1 c) I am cxxnmitted to the WtitiiX)' 




1 to Read Procrram 


1 4.3 1 


1 d) I am ccEtif ortable with the phonetic 




1 spelling enjiiasis of the Wtiting 


1 4.5 1 


1 to Read Proqram 





* 5=strcHTgly agree, 4=< jree, 3=neutral, 2=disagree, l=^trongly disagree 
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Olici '.cindergarten Teachers reported at least half of the students used 
a typewriter at least sanetimes. The students frequently used the parts 
of the typewriter correctly (Table 13) . 



Table 13 
Restxanses to T-zp ing (^iperf-^onc; 



i Questions 


1 1 
1 Avg. Response on a Scale | 




1 from 1-5 1 


1 a) Hew often do students lose 




1 the typewriter? 


1 3.6* 1 


1 b) Hew many students X2se the 




1 typ^fwriter? 


1 4.3** 1 


1 c) Hew many students put in 




1 their cwn paper? 


1 4.4**-> 1 


1 d) Hew many students iise the 




1 space bar correctly? 


1 3.6** 1 


1 e) Hew inaiiy students isse the 




1 t53per/lcwer case key? 


1 3.8** J 


1 f ) Hew loany students use the 




1 ao/ott cwitch by themselves? 


1 4.4** 1 


1 g) Hew many students lase the 




1 return Icey? 


1 4,1** 1 



5=always, 4=often, 3=saneti2ies, 2=rarely, l=never 
5=all, 4=3nost, 3=abcfut half the time, 2=a few, l=none 
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Most of the students \jsed the typewriter between three and four times 
per week. (Table 14) . 



Table 14 

Times Per Week Typewriter is Used 



Times Per Week 


i Piequency of Teacher Responses | 


1 


1 2 1 


2. 


i 3 1 


3 


1 7 1 


4 


1 5 1 


5 


1 ■ 1 1 



Hie students in most cases did their writing in lon^and before thev vised 
the typewriter (Table 15) . 



Table 15 

Students that Write Before Using Typewriter 



1 % of student Stories that are Written | 


% of Student Stories | 


1 Lonc^iand Before they are Typed | 


that are Typed Only | 


1 99% 1 


1% 1 



Most of the students were at the third cycle or above (Table 16) 
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Table 16 

Students Currently at Each of the 10 cycles 



10 cycles 


# Of StucJents in Each Cycle 


1 


0 


2 1 


9. 


3 1 


18 


4 1 


20 


5 1 


22 


6 1 


21 


7 1 


30 


8 1 


32 


9 1 


32 


10 1 


32 
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First Grade Survey 



Similar to the Idndergarten Teachers, the first grade Teachers 
r^rted, on the average, students practiced writing and used their own 
thou^ts and ideas often, and sametines corrected their own vrork without 
erasing and edited their writirg (Table 17) . Each of the first grade 
classes participating in the program averaged 24.1 students per class. 



Table 17 

Students' current Writing Performance 





Question j 


Avg. Response on j 
a Scale from 1-5 | 


1 ^* 


Students practice their | 
writing daily. | 


4.8 1 


1 b- 


Students write xising their| 
cwn thou^ts and ideas. | 


4.6 1 


1 c. 


Students correct their | 
own work without erasing. | 


3.5 1 


1 d. 


Students edit their | 
writing. ( 


3.6 1 

t 

1 
1 



sixty percent of the students used between 4 and 11 sentences per 
story (Table 18) . m addition, a total of sixty-two percent of the 
students used between two and three syllables per word (Table 19) . 



Table 18 

Ihe Nuniber of Sentences Used for stnr-lpg 



1 Number of Sentences 
1 Used for Story 


1 % of Students Using | 
1 Nuniber of Sentences | 


1 1-3 


1 8% 1 


1 4-7 


1 21% 1 


1 8-11 


1 39% 1 


I 12 or more 


1 32% 1 
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Table 19 

Nuniber of Syllables Used in Words 



1 # of Syllables 


% of Students | 


1 Used in Wbrds 




1 one 


17% 1 


1 two j 


31% 1 


1 three { 


31% 1 


1 fcwr 1 


17% 1 


1 five 1 


4% 1 



The hi^est percentages of students ware in stages 5, 1, 8, and 10 of 
writing (Table 20) . Most of the Teachers agreed students were benefitting 
from the program, that they themselves enjoyed teaching writing, and that 
they were conmitted to the writing program. However, the Teachers, on the 
average, were neutral about being comfortable with the phonetic spelling 
eirphasis of the program (Table 21) . 
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Table 20 



Ihe Perce ntage of Students in Each of the 10 Stages of Writincr 



j 10 stages 


i % of Students at 




1 Each Stage 


1 one 


1 1% 


1 two 


1 2% 


1 three 


1 3% 


1 four 


1 8% 


1 ■ five 


1 10% 


1 six 


1 9% 


1 seven 


1 12% 


ei^t 


1 21% 


nine 


1 9% 


ten 


1 25% 1 
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Table 21 
Responses to Wcltim Questions 





Question | 


Avg. Response on | 
a Scale from 1-5* | 


1 ^* 


Students learn well | 
frm ycwr t^riting to | 
Read follcw-im proaram j 


4.2 1 


1 ^* 


I enjoy teaching writing| 


4.5 1 


1 ^* 


I am ccranitted to the | 
writing program | 


4.6 1 


1 


I am coDttfortable with ] 
the phonetic spelling | 
emphasis of the brooram | 


3.9 1 



* 5=strangly agj^, 4=agree, 3=neutral, 2=disagree, l=sbroi^ly disagree 



The Teachers agrea\ that the writing lessons vrere effective with 
students and were helpful in the develcpnent of their am lessons (Table 
22} . 



Table 22 

ResTxanse s to Writing lesson Questions 



Question 



a. I found the writing lessons 
to be effective with students 



b. I found the writing lessons to 
be helpful in developing ny 
own lessons 



Avg. Response on 
a Scale from 1-5* 



4.6 



4.4 



* 5=strongly agree, 4=agree, 3==nfiutral, 2=disagree, l=strongly disagree 
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CurricaiLum Analy g^e; 



IV. Ifow do the cbjectives and performance indicators related to the 
W2R program relate to the objectives and indicators of the DOS 
Competency Based Curriculum in the area of writing? 

Dr. Mattde C. Williams, Bureau Qiief for Language Arts in the Chicago 
Public Schools served as an outside consultant for the corponent of the 
evaluation study that involved an analysis of the writing strand of the 
English curriculum. Among the questions that Dr. Williams was asked 
relative to writing were questions relative to relationship of the Writing 
to Kead program to the writing curriculum. Hor responses to those 
questions and recommendations are summarized below. 

"How do the activities proroated in the Writing to Read program 
correlate with the primary level writing tasks indicated in 
the curriculiaa guide?" 

Response 

"Ihe activities in tiie Writii^ to Read program seem to exceed those 
activities delineated in- the priitary curriculian in terms of considering 
writing as a process. Writing is the focus of the language arts program. 
Despite tSie fact that Writing to Read program uses the phonetic approach 
to language arts instructioii, language development is of primary concern, 
and Instruction en^phasizes reading, writing, and the \ise of the 
technological advantages of the conpiter. Ten writing stages with their 
corresponding criteria have been identified for evaluating students' 
writir^. " 

"Does the Writing to Read program inpede or promote student 
ability to write ?" 

Response 

"Data from the Educational Testing Service (BIS) evaluation of the 
Writing to Read program of JUly 1984 and the Writing Scale for Young 
Children developed for the District of Columbia by Dr. Deloris M. Saunders 
and Ms. Thelma Michael substantiate the fact that the prtjgram prtanotes 
students' ability to write." 

"Since Writing to Read will be placed in most schools with 
kindergarten and first grade students within five years, what 
adjustments in the writing curriculum need to be made to 
acccsoodate student writing skills at the primary level?" 
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Response 



"Olie writing curriculum should be revised to reflect the outccraes that 
emerge throu^ the iirplementation of the Writing to Read program. A 
greats eirphasis should be placed on writing as a process-to-product 
entily. 

Ihe curriculum should be modified to acccmodate the deficits and to 
provide for the increased proficiency of those students v4io are 
participating in the Writing to Read progrcon." 



" Recommendations 



"It seems litperative, therefore, that-^ 



i^rcpriate staff within the Department of Curriculum and 
the coordinator of the Writing to Read program set \jp 
articulation sessions so that there is an integration of 
both curricula. 

The objectives and writing strategies of the Writir^ to 
Read progrcim be correlated with the objectives and 
production activities of- the regular program of instruction. 

All activities of the Writing to Read program be an integral 
part of the curriculum." 
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Discussion 



The findings indicate that kindorgarten students participating in the 
Writing to Read program aade significant gains in rtsading achievement but 
not in language achievement as measured by the Metropolitan Achievement 
Test. First grade differences in achievement were not-significant. The 
lack of significance at grade one may be due in part to the eirphasis at 
first grade on student mastery of the skills outlined in the Competency 
Based Curriculum (CBC) , the hic^ier skill level of the Writii^ to Read 
program in relationship to the skills measured by the CBC and variance in 
the reinforcement of the skills acquired in the Writir^ to Read program. 
This conclusion is si^portsd by the findings of Dr. Mattie c. Williams v*o 
served as a curriculum consultant for this sbady and the DCPS writing 
evaluation stu^. Dr. Williams indicated: 

. . . activities in the Wtitlng to Read program seem to 
exceed those contained in the priiaary curriculum in terms 
of considering writing as a process. . . The writli^ 
curriculum should be revised to reflect the outccanes that 
emerge throu^ the inplementation of the Writing to Read 
program. 



Dr. Williams reconmended that coordination occur between the Si?jervising 
Directors of English and Reading and the Writii^ to Read program 
coordinator to facilitate integration of the higher level skills acquired 
in the Writing to Read program and to encourage curriculum correlation. 

Both the Writing to Read and the comparison grot?) children made 
significant achievement gains from the pre- to the post-test during the 
s<±iool year. At the kindergarten level, the mean pre-test performance of 
Writing to Read children was lower in reading and language. At first 
grade, comparison gracp children yielded lower pre-test scores than did 
the Writing to Read children. Hbtvever, the mean pre-test performance of 
first grade participants in the Writli^ to Read program was thirty-five 
(35) scale score points hi^ier in readii^ and twenty-one (21) points 
hitler in language than the performance of the control group. The 
post-test scores of W2R first graders was also hi^ier than those of the 
control . gra^ thou^ not-significant. In all but one instance 
(kindergarten reading) , the grot?) with the lowest pre-test scores made the 
greatest gains in acJiievement. Regression towarxJs the mean mi^t have 
been a factor tliat si^jpressed the t^ performance of Writing to Read 
program students. Efforts were made to statistically control for pre-test 
differences by use of the Analysis of Covariance statistical procedure. 

In terms of growth in the area of writir^ ability, Writing to Read 
children made significantly greater growth at grades K and one vdien 
ccotpared with non-^7riting to Read students. It would appear that 
participation in the Writing to Read program mi^t be better assessed by 
growth in the level of writing ability/stage and reading achievement 
rather than by simply looking at performance on a standardized achievement 
measure (especially now that a direct indicator of writii^ ability and 
stage of develcpnent can be used as opposed to the indirect indicator 
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language adhievemer^:) . Data also indicate that the ratirg of writing 
sanples by two ind^jendent raters showed a hi^ degree of cxansistency 
(88%) vMch adds credence to a possible en?diasis on the use of writing 
ability as an indicator of success as opposed to merely considering 
perfonnance on an achievement test. 

Writing to Read Teachers r^rted that the Writing-!Ib-Read Program had 
inproved the writing skills of the students and had trained them to vise 
the t^'pewriter and process writii^ correctly, students made significant 
gains in the quality, length and level of writii^ products across the 
year. Teachers also were satisfied with the format and the philosophy 
behind the program. 

In general, the greatest progress is beii^ made in writing ability 
aro^s grade levels wlien students are participants in the Writii^ to Read 
program. Achievement gains as noted liy the Metropolitan Achievement Test 
were significant in reading for Writing to Read participants in 
kindergarten and not-significant for first grade students. Differences in 
eiriiiasis on CBC skills frcaa kindergarten to first grade and lade of 
curriculum correlation between the Writir^ to Read program and the reading 
and English curricula, as well as conflicts as- to >diat should be taurfit, 
are likely sources of differences in instruction and student adiievement 
at grade one. Both the cutside consultant and the evaluator agree that a 
need exists for articulation and correlation relative to the Writing to 
Read program and tJoe CBC in reading and writing. 
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Becxamnendations 



Draft cxpies of the evaluation report were delivered to Si^jervisors, 
Principals and Teachers, vdio were se:iec±ed ty the evaliiator, for persual. 
Representatives of the grcxp that reviewed the report were invited to 
attend a meeting held at Young Elementary School to generate 
reocnnnendations based on the findii^ of the evaliiation report. Araong the 
ei^teen persons attendli^ the meeting were the Si^jervising Directors of 
English and Reading; the Assistant Director of Reading; two R^ional 
Si^jervisors; two Principals frm schools involved in the stud/ (caie with 
Writing to Read and one without) ; one Early Childhood Peer Assistant 
Teacher; and five Teachers (three Teachers from schools with Writii^ to 
Read and two without) . Attending frcm the Writing to Read program were 
the Coordinator, the Consultant and the two Resource Teachers. 

Die following Recammendations were generated based on the f indiros of the 
evaluation report. 



1. Ohe relationship between the instructional skills and activities 
provided throu^ the Writing to Read program and the skills 
outlined in the Conpetency Based Curriculian needs to be 
articulated to instructional personnel using the ^Triting to 
Read program. 

Presently, achievonent in thjs Writii^ to Read program as it 
is measured by standardized adhi.evement instruments indicates 
no difference exists between the performance of Writii^ to 
Read and occparison grot?) first grade students. Etersons 
generating this recamnendation at the Yourg School Meeting 
indicated one of the resisons for the lack of difference 
is that some Principals and Teachers involved with Wtitim 'to 
Read ©qjerience difficulty understandit^ the relationship 
between the CBC skills and cbjectives and the objectives of the 
Writing to Read program. Diey see the two as unrelated rather 
than as ccsxplementary programs, since Teachers are evaluated 
in part based on their ability to progress throui^ the CBC, they 
tend to emphasize skills on the CBC chedaist (especially since 
pranotion is based on student progress on CBC mathematics and 
reading cbjectives. Some felt that the prcsiDtion standard 
should be based on performance in mathematics, readim and 
writing) . it wculd follow that Writl:^ to Read first grade 
student performance cn achievement measures wculd not be 
different fron cccparison students if the materials and 
training provided to participating first grade Oteachers is not 
being fully Inplemented. Die participants attendii^ the 
Young ScJiool Meeting reccmnended that staff developnent be 
provided for Principals and Teachers which demonstrates how 
the Writing to Read program reinforces CBC skills and vMch 
provides strategies f ci' incorporating Writing to Read activities 
into the skills and cbjectives provided by the CBC without 
limiting Instructional opportunity in other subject areas. 
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Articulation and collaboration needs to be strtictured and reinforced 
between the Writir^ to Read program and the Er^lish and Readir^ 
D^arbnents to foster cchesiveness amcng the three programs. 



More articulation needs to take place between the Writii>g to Rsad 
program and the English Departanent. Hhe Writing to Read program 
staff has done an outstanding job of erihancsii^ the vnritir^ 
develoftaent of kindergarten ana first grade students that is 
being recognized by educators across the country, with the 
onset of the Writing Initiative, every elementary school Oteacher 
could benefit froa learning how to e^ly the Writii^ Scale 
developed by the Writing to Read program in DCPS to guage the 
ability and level of writing developnent of young children. 
Collaboration and articulation would also aid both grocps in 
spreading the word to elementary schools through presentations 
and workshops with system Writing- Coordinators, Principals and 
Teachers. Bie English D^artment has a network already in place 
that would facilitate this (eg., Writii^ Coordinators, Language 
Arts Resource Teachers, the Writii^ Initiative Newsletter, etc.) . 
In order to prcmote cohesiveness between activities related to 
the Writing to Read program and the writing curriculum, teachers 
presently implementing the Writing to Read program should be 
considered vflien forming curriculian development teams. 

■me Writing to Read program and the Readit^ Department have 
worked together previously to correlate the activities contained 
in the Writing to Read program with the CBC readir^ objectives. 
Ihe two should work together to share the ccaofponents of the 
Writing to Read program with Keadiig Resource Teachers and 
other appropriate personnel in varia's forums provided by the 
Writing to Read program and the Reading Department. Tn addition. 
Writing to Read program activities and objectives should be 
reviewed in li^t of recent modifications in the reading 
curriculum. 



An awareness strategy needs to be established to share information 
on the skills developed by the Writii^ to Read program across schools 
and primary grade levels. 

niis reccanmendation encourages more frequent articulation and 
collaboration between kindergarten and first grade Writii^ to 
Read Teachers in each school as well as plannii^ and sharii^ 
with Teachers in grades two thrcuf^ six (with strategies provided 
for reinforcing learned writit^ skills) . A concerted effort 
should also be provided for Teachers e:5>erienced with the Writing 
to Read program to share with new p r o grdm pa2±icipants in f onnal 
and informal settings so new participants approach the program 
with realistic expectations. This information should also be 
shared in fonmia involving non-participating schools. 
Principals and Si^jervisors so knowledge of the Writi:^ to Read 
program can be ej^anded. Bie ultimate goal of this 
reocsnmendatioai is to develop a mechanism to share and build vpan 
the Gkills developed by the Writing to Read program with others. 
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